Smart speaker with multifunctional faceplate and local environment sensing

ABSTRACT

In particular embodiments, a smart speaker includes a speaker, a housing with a speaker grille portion, a circuit board, and one or more indirect input sensors (e.g. an antenna or a proximity sensor). The grille can comprise a first plurality of openings. The circuit board can reside behind the grille and in front of the speaker (e.g. in the path of sound transmission from the speaker). The circuit board can be a substrate for the one or more indirect input sensors. The circuit board can further comprise a second plurality of openings, at least some of which align with at least some of the openings in the grille, thereby providing sound transmission through the circuit board, while providing improved access for the sensors to the local environment in the vicinity of the smart speaker. Several embodiments enable the region behind the speaker grille to accomplish the dual functions sensing the local environment and sound transmission. For example, an indirect input sensor may detect aspects of the local environment (e.g. hand gestures made by a user, or the location of a person) and activate one more aspects of the smart speaker in response (e.g. illuminate a display).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of application Ser. No.14/918,586 filed on Oct. 21, 2015, which is a continuation ofapplication Ser. No. 14/788,726, filed on Jun. 30, 2015, now U.S. Pat.No. 9,196,432 which claims the benefit of provisional patent applicationNo. 62/054,389, filed on Sep., 24, 2014 by the present inventor.

TECHNICAL FIELD

The present disclosure relates generally to systems and methods forcombining audio capability and local environment sensing (e.g. voicedetection, occupant location, gestures, and RF signals) in the grilleportion of a smart speaker. In particular, the technology relates to awireless speaker that provides means for both sound transmission andimproved sensing of the local environment.

BACKGROUND

The proliferation of consumer wireless electronics (e.g. smartphones,tablet PCs and laptops) has resulted in consumers increasingly carryingmusic collections with them. Speaker manufacturers have responded tothis market trend by making smaller, more portable wireless speakers andwireless multi-room speakers (e.g., Bluetooth portable speakers andmulti-room Wi-Fi speakers). As the form factor of wireless speakersshrinks, the proportion of the enclosure occupied by the speaker element(e.g. the speaker cone and electromagnetic driver) has increased. In arelated area, a new generation of smart speakers (e.g. the Amazon Echofrom Amazon Inc. of Bellevue Wash. and the Google Home speaker fromGoogle Inc. of Mountain View Calif.) are combining wireless musicstreaming with local environment sensing (e.g. voice and proximitydetection) and automatic speech recognition (ASR). Smart speakers canact as an interface to the World Wide Web as well as an interface tohome automation devices (e.g. providing control for smart thermostatsand smart televisions) Enhanced sensing of the local environment is anactive area of innovation for smart speakers. Examples include, sensingthe location of people, identifying speech across a noisy room, orsensing the presence of smart building devices. The speaker element of atraditional speaker can pose several challenges to the goal of sensingthe local environment. The speaker element can be large and can occupymuch of the available space in the enclosure. In addition, the speakerelement can cause electromagnetic interference.

In conclusion, insofar as I am aware, no speaker assembly previouslydisclosed has provided sound transmission while providing effectivesensing of the local environment in the vicinity of the speakerassembly.

SUMMARY

In one embodiment, a smart speaker has an environmental sensingfaceplate subassembly located in the path of sound transmission from aspeaker component, the subassembly being operable to provide both soundtransmission and sensing of the local environment. In anotherembodiments an environmental sensing faceplate subassembly comprises: afront surface with a grille, a circuit board places in the path of soundtransmission from a speaker and an indirect input sensor, wherein thecircuit board comprises means that enable the indirect input sensor tosense an aspect of the local environment (e.g. the room where the smartspeaker resides) and wherein the circuit board has openings that alignwith the grille to promote improved sound transmission from the speaker.

In particular embodiments, a smart speaker includes a speaker, a housingwith a speaker grille portion, a circuit board, and one or more indirectinput sensors (e.g. an antenna or a proximity sensor). The grille cancomprise a first plurality of openings. The circuit board can residebehind the grille and in front of the speaker (e.g. in the path of soundtransmission from the speaker). The circuit board can be a substrate forthe one or more indirect input sensors. The circuit board can furthercomprise a second plurality of openings, at least some of which alignwith at least some of the openings in the grille, thereby providingsound transmission through the circuit board, while providing improvedaccess for the sensors to the local environment in the vicinity of thesmart speaker. Several embodiments enable the region behind the speakergrille to accomplish the dual functions sensing the local environmentand sound transmission. For example, an indirect input sensor may detectaspects of the local environment (e.g. hand gestures made by a user, orthe location of a person) and activate one more aspects of the smartspeaker in response (e.g. illuminate a display). In some embodiments thedisclosed invention enables the system to detect when a person isproximal to the smart speaker and activate an aspect of the smartspeaker.

The techniques described in this specification can be implemented toachieve the following exemplary advantages: The field of view ofindirect input sensors can be improved by enabling them to be placed inclose proximity to the speaker grille and in some cases in the path ofsound transmission from the speaker to the grille. In a relatedadvantage the indirect input sensors can benefit from direct line ofsite to the local environment in front of the speaker grille through theopenings in the grille. In another advantage placement of the indirectinput sensors forward of the speaker cone can provide a location withlower electromagnetic interference. In yet another advantage theplurality of openings in the circuit board(s) can act to improve thesensing by conditioning sensor signals from the local environment (e.g.collimating light to a narrow range of angles as it passes through theopenings, attenuating particular sound or RF frequencies, forming viaholes between two or more layers in circuit board, or forming part of anantenna).

DRAWINGS

FIG. 1 is an exemplary diagram of the front faceplate of an electricalswitch assembly with audio capability and means for a user to operatetwo switches in accordance with an aspect of the present disclosure.

FIGS. 2A and 2B is a disassembled view of an electrical switch assemblywith audio capability, including a speaker, and a touch sensitivefaceplate in accordance with an embodiment of the present invention.

FIG. 3 is a block diagram illustrating various components of anelectrical switch assembly with audio capability in accordance with oneembodiment of the present technology.

FIGS. 4A and 4B illustrates an exemplary front view of a faceplate witha touch sensitive speaker grille and two circuit boards in accordancewith one embodiment of the present technology.

FIGS. 5A to 5C. illustrates a finger interacting with a target sensorelectrode and a neighboring sensor electrode in accordance with oneembodiment of the present technology.

FIG. 6 illustrates an insulating electrical substrate with conductiveelectrodes designed in accordance with one embodiment of the presenttechnology.

FIG. 7 illustrates various elements of an indicator light assemblyincluding insulating electrical substrate with light emitting elementsin accordance with one embodiment of the present technology.

FIGS. 8A and 8B illustrate exemplary front views of a faceplate with aspeaker grille operable to sense direct user interaction in accordancewith one embodiment of the present technology.

FIG. 9 illustrates an exemplary rear view of a faceplate with a touchsensitive speaker grille in accordance with one embodiment of thepresent technology.

FIG. 10 illustrates is a disassembled view of an interactive speakergrille in accordance with an embodiment of the present invention.

FIG. 11 illustrates exemplary front views of a faceplate with a speakergrille and solid center section in accordance with one embodiment of thepresent technology.

FIG. 12 is a flow chart diagram that outlines the operation of anelectrical switch assembly with audio capability in accordance with anaspect of the present disclosure.

FIG. 13 is a flow chart diagram that outlines the operation of anelectrical switch assembly with audio capability and illuminated switchindication in accordance with an aspect of the present disclosure.

FIG. 14 is a flow chart diagram that outlines the operation of aninteractive speaker grille with audio capability and illuminated grilleregions in accordance with an aspect of the present disclosure.

FIG. 15 is a flow chart diagram that outlines the operations associatedwith integrating an electrical switch assembly with audio capability,including a touch sensitive speaker grille.

FIG. 16A illustrates a traditional arrangement of a speaker and aplurality of indirect input sensors.

FIGS. 16B and 16C illustrate a speaker and an environmental sensingfaceplate subassembly, in accordance with several embodiments of thepresent disclosure.

FIG. 17 illustrates a smart speaker according to an embodiment of thepresent disclosure.

FIG. 18 illustrates a disassembled view of a smart speaker including aplurality of indirect input sensors located on a circuit board inaccordance with an embodiment of the present disclosure.

FIGS. 19A, 19B and 19C illustrate exemplary placement of a circuit boardwith an indirect input sensor, wherein the circuit board is placed inthe path of sound transmission from a speaker to the region in front ofthe speaker grille, in accordance with several embodiments of thepresent disclosure.

FIG. 20 illustrates a display on a circuit board in the path of soundtransmission from a speaker to a region in front of a speaker grille, inaccordance with an embodiment of the present disclosure.

FIG. 21 is a flow diagram that outlines the operations associated withintegrating environmental sensing into a smart speaker in accordancewith an embodiment of the present disclosure.

DETAILED DESCRIPTION—FIG. 1-FIG. 11

In the following detailed description, for purposes of explanation,numerous specific details are set forth to provide a thoroughunderstanding of the various implementations of the present invention.Those of ordinary skill in the art will realize that these variousimplementations of the present invention are illustrative only and arenot intended to be limiting in any way. Other implementations of thepresent invention will readily suggest themselves to such skilledpersons having the benefit of this disclosure.

In addition, for clarity purposes, not all of the routine features ofthe implementations described herein are shown or described. One ofordinary skill in the art would readily appreciate that in thedevelopment of any such actual implementation, numerousimplementation-specific decisions may be required to achieve specificdesign objectives. These design objectives will vary from oneimplementation to another and from one developer to another. Moreover,it will be appreciated that such a development effort might be complexand time-consuming but would nevertheless be a routine engineeringundertaking for those of ordinary skill in the art having the benefit ofthis disclosure.

It is to be appreciated that while one or more implementations aredescribed further herein in the context of a typical building basedelectrical switch assembly used in a residential home, such assingle-family residential home, the scope of the present teachings isnot so limited. More generally, electrical switches with audiocapability according to one or more of the preferred implementations areapplicable for a wide variety of buildings having one or more speakersincluding, without limitation, duplexes, townhomes, multi-unit apartmentbuildings, hotels, retail stores, office buildings and industrialbuildings. Further it is to be appreciated that an electrical switchwith audio capability according to the implementations disclosed couldbe implemented in ships and airplanes. Further, it is to be appreciatedthat while the terms user, customer, installer, homeowner, occupant,guest, tenant, landlord, repair person, and the like may be used torefer to the person or persons who are interacting with the speaker orother device or user interface in the context of one or more scenariosdescribed herein, these references are by no means to be considered aslimiting the scope of the present teachings with respect to the personor persons who are performing such actions.

FIG. 1 is a diagram illustrating the front view of an exemplarywall-mounted electrical switch assembly 100 in accordance with anembodiment of the present disclosure. The electrical switch assembly 100is designed to reside in an electrical junction box (not shown in FIG.1). FIG. 1 illustrates a 2-bay switch assembly. A touch sensitivefaceplate 105 controls power to two wires 110 a and 110 b and therebycontrols the operation of two lights 115 a and 115 b. Alternativeimplementations of this disclosure can include other sizes of electricalswitch assembly optimized for different sizes of electrical junction boxdesigned to serve different numbers of building-based electrical devices(e.g. Lights, switch operated electrical outlets or garbage disposals).For example, a single bay junction box is common in many bedrooms toaccommodate a single light switch, while other locations may have threeor four bay junction boxes. Faceplate 105 contains a plurality ofopenings 120 that form a speaker grille 114. A substantial portion ofthe faceplate 105 can be occupied by speaker grille 114 (e.g. 50-100% ofthe total area of the front surface of faceplate 105). Grille 114protects a speaker (not shown in FIG. 1) located behind the faceplatewhile enabling effective sound transmission through the openings 120.The faceplate, and in particular speaker grille 114, is touch-sensitive,thereby enabling a person 125 to touch portions of the speaker grille114 to operate lights 115 a and 115 b. Speaker grille 114 combines avariety of functions including sound transmission, light switch control,speaker protection and user protection. Aspects of the presentdisclosure show how to implement touch sensor functionality, whileproviding sound transmission through a large number of openings in thegrille 114. The touch sensitive speaker grille 114 and faceplate 105 canregister binary user commands (e.g. ON/OFF) as well as continuum userinput commands (e.g. increase illumination with a dimmer). Elements 130a, 130 b and 130 c are regions of the faceplate that illuminate in orderto further facilitate a user 125 with visual feedback. For exampleelements 130 a and 130 b can show the present state of the electricalswitches number 1 and number 2 (e.g. ON/OFF/dimmed). In oneimplementation elements 130 a and 130 b are two elongated lines of lightindicating the position of two dimmer switches. The user 125 can touchthe faceplate 105 and drag the illuminated indication regions 130 a and130 b up or down to a desired location and controlling lights 115 in theprocess. Faceplate 105 designed in accordance with the presentdisclosure provides means for visual switch position indication andtouch sensitive surfaces while facilitating sound transmission with alarge speaker grille portion 114. In some implementations the touchsensitive speaker grille 114 can provide improved access for sensorspositioned behind the faceplate (e.g. passive Infrared, active infraredproximity sensors or temperature sensors) to measure the environment inthe region in front of the faceplate 105. In some implementationssensors located behind the touch-sensitive speaker grille can provideenhanced sensing of a person in the vicinity of the switch assembly andilluminate regions 130 a, 130 b and 130 c when a person is nearby. Inthe implementation illustrated in FIG. 1 electrical switch assembly 100,receives wireless signals 135 and can play music or audio messages froma variety of wireless devices 140, for example a smartphone 140 a, atablet PC 140 b or a media server 140 c. The media server 140 c can bean internet gateway (e.g. a home broadband internet router) and transmitinternet radio content to electrical switch assembly 100.

FIGS. 2A and 2B are disassembled views of an electrical switch assemblyincluding a speaker grille 214 that can sense direct user interaction(e.g. touch or pressure) in accordance with one implementation of thepresent disclosure. Switch assembly 100 contains a housing 210. Housing210 is a mechanical enclosure for components of electrical switchassembly 100. In one implementation housing 210 provides electrical andmechanical separation for components in electrical switch assembly 100from the contents (e.g. wires) in an electrical junction box 215.Housing 210 can contain two or more electrical terminals 290 operable tobe attached to building-based wiring. Building based wiring can includewiring within the walls of a building or carried in metallic or plastictubing for the purpose of electrically connecting switches and servicepoints in the building. Service points can include wall mountedelectrical sockets, HVAC equipment, sprinkler components and lightingfixtures in ceilings and walls. Examples of terminals 290 include screwterminal (e.g. those found on many light switches) and wire pigtails(e.g. a length of wire protruding from the housing). Housing 210 may besized to fit in an electrical junction box 215 of a particular size. Forexample the two-bay junction box illustrated in FIG. 1 is approximately4 inches wide and can accommodate two standard electrical lightswitches. The exemplary housing 210 in FIG. 1 is approximately 4 incheswide and 4 inches high and is designed to fit inside the majority oftwo-bay electrical junction boxes. Housing 210 has forward facingsurfaces 217 a and 217 b.

Housing 210 contains a speaker 205 operable to generate sound in theregion of the assembly. Speaker 205 functions to emit sound through thegrille portion 214 of faceplate 105. Grille 214 and grille 114 areoperable similar exemplary grilles with different shapes. Speaker 205can be an electromagnetic type speaker with an external or internalelectromagnet. In FIG. 2A speaker 205 is located centrally in housing210 and can occupy the position traditionally occupied by one or moremechanical switches. In another aspect of several embodiments thespeaker grille is designed to fulfill the function of the electricalswitches, including dimmer switches, that would traditionally occupy thespace where speaker 205 is placed. Speaker 205 can have mountingfeatures securing it to the housing 210 and in some embodiments anair-tight seal is be formed between speaker 205 and housing 210 thatenables further audio quality enhancement. Speaker 205 can have amounting flange 206 operable to secure the speaker to housing 210.Mounting flange 206 can have a variety of shapes including square orcircular. Speaker 205 has a speaker cone 207 operable to move in thepositive and negative Z direction when the electromagnet in the speakeris energized. The cone has a forward facing surface operable to projectsound in the Z direction. In one embodiment the electrical switchassembly is designed to fit inside a 1-bay electrical junction box withdimensions of approximately 2 inches in the Y direction of FIG. 2A and 4inches in the direction of X in FIG. 2B. In this embodiment the assembly100 could contain a 3 W 4 ohm speaker with a speaker cone with adiameter of approximately 50 mm. In another embodiment the electricalswitch assembly 100 is designed to fit inside a 2-bay electricaljunction box with dimensions of approximately 4 inches in the Ydirection of FIG. 2A and 4 inches in the positive X direction in FIG.2B. In this embodiment assembly 100 can contain a larger speaker with acone of diameter 76 mm. Speaker 205 could be model number 1-530-767-12from Sony. Speaker 205 can have a similar design to the speakercomponent used in a portable Bluetooth or Wi-Fi enabled wirelessspeaker, for example Jawbone Jambox®. In some embodiments electricalswitch assembly 100 can include two or more speakers. This is sometimesadvantageous when more sound volume is required than can be provided bya single speaker.

Electrical switch assembly 100 can contain a faceplate 105 with a frontsurface including portions 212 a and 212 b. The front surface caninclude a large portion 212 a in the X-Y plane and can also include theedges of the faceplate 212 b. The front surface including portions 212 aand 212 b provide surface for the user to interact while at the sametime faceplate 105 provides electrical isolation, between the user andhigh voltage components in the switch assembly behind the faceplate.Faceplate 105 can be constructed from a variety of materials includingplastics, glass or enamel covered metal or metal. Faceplate 105 can beflat with rounded edges as illustrated in FIG. 2A and FIG. 2B. In otherembodiments faceplate 105 can have a curved structure that can provideincreased mechanical stiffness, when the front of the faceplate istouched or pressed. Faceplate 105 can contain one or more ribs molded onthe interior surfaces to further increase mechanical stiffness.Faceplate 105 can function to conceal the gaps between the enclosure 210and the electrical junction box 215. The faceplate provides anaesthetically pleasing front surface for the user to interact with whileconcealing gaps between paint or drywall interfaces and junction box215. FIG. 2B illustrates that faceplate 105 contains a plurality ofopenings 120 that form a speaker grille portion 214 of the faceplate.Openings 120 can have a variety of shapes including circular, diamond,or oval. Speaker grille 214 is designed to transmit sound into the airspace in front of the faceplate in a manner so as to provide effectivesound to a user in the vicinity of the electrical switch assembly. FIG.11 illustrates that speaker grille can be disposed as a complex shapecomprising a plurality of openings 120 surround one or more solidsections 1110. A solid section 1110 could be a decorative surface for amanufacturer to place a logo, hold a button, hold a touch sensitivebutton or an illuminated element. In the context of this disclosure aspeaker grille refers to a portion of the faceplate 105 comprising aplurality of openings operable to transmit sound from a speaker andwould not include the solid section 1110 illustrated in FIG. 11. In someembodiment the grille comprises several small clusters of openings. Inthis case the grille can refer to the combined portions of the faceplatecovered by the openings. In the absence of molded features, edges ormaterial differences delineating the boundary of the speaker grille 214portion of faceplate 105, the grille portion can considered to bebounded by straight lines joining the points on the perimeter of thoseopenings that form the perimeter of a plurality of openings. Faceplate105 contains one or more regions 240 wherein direct user input (e.g.,touching, swiping or pressing) is operable to be sensed by one or moresensor electrodes 255. For example regions 240 a, 240 b and 240 c inFIG. 2A are exemplary touch sensitive regions used to control theoperation of two electrical switches. In one implementation user inputregion 240 a functions as a binary switch to turn off switch number 2.While the exact mechanism for turning off switch number 2 in response todirect user input is detailed later, it can be appreciated that regions240 are operable to initiate the process of controlling one or moreelectrical switches. For example the region 240 c is operable to receivedirect user input and direct user input sensors 330 (in FIG. 3) behindthe faceplate can initiate the turn on of switch number 2. In anotherexample a user input region 240 b of the faceplate 105 can function toact as analog switch, capable of controlling light 115 a to have a valuewithin a range of switch values (e.g. from 0 to 100). Examples of analogswitches include slider actuators, dimmer switches, rotary dialswitches. Physical features on the faceplate can indicate the intendedfunction of a region. For example in FIG. 2B switch number 1 and switchnumber 2 can be separated by a molded feature 225 delineating theboundary between the two switches on the common faceplate. Features 225can also be deposited on the faceplate using other technologiesincluding printing, etching, painting, overlay or electroplating. Userinput regions can control a function that is variable and dynamicallydefined by a computer processor. Region 240 d illustrate an example of aregion that could initiate a plurality of control functions in a speakerapplication for example changing the volume, selecting a song, playingor pausing music or selecting an input source. In one implementation thefunction of 240 d can be defined by the direction or gesture the usermakes while touching the region. For example swiping up and down maycontrol light switch functionality, while swiping from left to right maydecrease sound volume of the speaker and right to left may increasesound volume. The differentiation of these functions can be provided bythe sequence of sensors 330 (in FIG. 3) activated behind the frontsurface of region 240 d. The function of region 240 d can be based inpart the prior sequence of regions 240 that the user has interactedwith. Illuminated sections of the faceplate 130 can indicate the presentfunctionality of region 240 d.

In the embodiment illustrated in FIG. 2B speaker grille 214 occupies alarge portion of the faceplate 105. In this context a large portion canrange from 30-100% of the faceplate area. In one aspect of thisdisclosure user input regions 240 overlap with grille 214. In someembodiments user input regions can be fully contained within the grilleportion of the faceplate. Speaker grilles are common on most speakers,where they provide mechanical protection for the sensitive speakercomponents while providing a path for sound vibrations to be emitted.

Electrical switch faceplates are required to provide electricalinsulation between a user and high voltage components (e.g. wires)inside the junction box. In one aspect of the present disclosureelectrical switch assembly 100 has a speaker grille 214 made from anelectrically insulating material, for example plastic, glass, glassfilled plastic, or ceramic. In one embodiment shown in FIG. 2A and FIG.2B the grille and the surrounding area of the faceplate are made fromthe same piece of plastic, with the grille comprising a plurality ofopenings 120 covering the center section of the faceplate. In otherembodiments the grille may be different material from the rest offaceplate, for example a plastic grille with an insulated metallicfaceplate. The openings can be a wide variety of shapes (e.g. circular,square or elongated slots). A speaker grille is a combination ofopenings 120 and solid portions between the openings. The arrangement ofopenings and solid portions often forms a pattern and enhances theaesthetic appeal of the speaker enclosure. The combination of openings120 and solid support material is designed to achieve competing goals ofblocking or filtering objects larger than the grille openings whileenabling air and sound waves to pass through the grille. The grille isnot a perfect sound transmitter. The solid portions of the grilleattenuate or diminish several physical properties such as soundintensity, light intensity and air flow. Sound attenuation can be causedby sound reflected back towards the speaker as it attempts to passthrough the grille.

FIG. 2A illustrates a circuit board 260 behind the faceplate 105 andplaced in front of the speaker 205. The circuit board has an insulatingsubstrate 262 that functions to hold conductors 254 and sensorelectrodes 255 operable to sense direct user input. Conductors 254 canfunction to carry signals to and from sensor electrodes and can have alarge ratio of length to width (e.g. >100). Modern circuit boardmanufacturing technologies such as photolithography and foil etching canproduce conductor features 254 as narrow as 40 micrometers. Electrodesare operable to sense an aspect of a user (e.g., capacitive orresistance changes associated with a user touching the front surface offaceplate 105. Electrodes can have a larger surface are and smalleraspect ratio than conductors on the same circuit board. Circuit board260 has a plurality of openings (e.g. 220 a and 220 b). Openings 220 aand 220 b function to enable sound from the speaker 205 to pass throughthe substrate. Openings 220 are designed to align with openings 120 inthe faceplate so as to not to add to the overall sound attenuation andreflection of the grille. In one implementation opening 220 a is largerthan the corresponding opening 120 a in the faceplate and can be largeenough to cover multiple holes in the front faceplate. In oneimplementation 220 a can be larger than the opening 120 a in the speakergrille. For example openings 220 a could be a slot encompassing twoopenings in the faceplate. In some embodiments circuit board 260 can bea rigid circuit board made from layers of fiberglass and epoxy withdeposited conductors. In other implementations circuit board 260 is aflexible circuit board. The faceplate 105 with speaker grille 214 can becombined with one or more circuit boards 260 to form an interactivegrille. The interactive grille enables the switch assembly to transmitsound while accomplishing the task of switch power to household items.The switching functionality is accomplished by splitting the switchingtask into two functions sensing and power switching. The interactivegrille enables the sensing to take place on the sound transmittinggrille while the power switching is accomplished by circuitry locatedaway from the path of sound transmission. Examples of circuitry locatedaway from the path of sound transmission include low voltage switchesand high voltage switches located behind the speaker in enclosure 210.One high voltage switch 280 is illustrated behind the speaker in FIG.2A. In the context of this disclosure high voltage refers to voltageswith magnitudes greater than 20 volts. Low voltage refers to voltageswith magnitudes in the range 0-20 volts. Examples of high voltageswitches include electromechanical relays, solid state relays andtriacs. A triac is a fast solid state switch often used to implementdimmer switches in buildings. Grille 214 can be larger than the speakercone 207 extend beyond the speaker in the X-Y plane, thereby providingthe benefits of access to the surrounding air to additional sensors inthe electrical switch assembly. The speaker cone 207 is defined by theinside perimeter of speaker flange 206. For example a microphone 268could be placed in the housing and behind the grille, whereby theinteractive grille provides improved sound coupling and thereforeimproved sound sensing in the vicinity of switch assembly 100.Similarly, a passive infrared sensor 269 can be placed behind theinteractive grille to sense motion in the vicinity of the speaker.Openings in the grille provide enhanced motion sensitivity. In otherembodiment some or all of the sensor electrodes 255 can be depositeddirectly onto the rear surface of the speaker grille usingelectroplating or conductive inks. It would be known to someone skilledin the art that conductors and electrodes can be deposited on3-dimensional polymer parts using modern technologies such as LaserDirect Structuring (LDS) or Molded Interconnect Device MID technology.

Mounting features 256 on the housing 210 can be connected tocorresponding mounting features 222 on the electrical junction box 215.For example 256 can be an oblong opening in the housing 210 and feature222 can be a threaded hole. A screw could be used to connect 256 and222. This arrangement enables fine adjustment of the orientation of thehousing. In some embodiments additional mounting features 257 a-d areoperable to secure faceplate 105 to the housing 210. In severalembodiments mounting features 257 a-d are load sensors. This enables thefaceplate to be attached to the housing in a manner enables the loadsensors 257 a-d to generate sensor signals when the faceplate is touchedor pressed. For example mounting features 257 a-d could be planar beamtype load sensors such as those available from Omega Engineering INC,Stamford Conn. In some embodiments there may more or less load sensorsthan the four shown in FIG. 2A. In response to a user touching orswiping an area of the faceplate the timing and sequence of load sensorsvalues can be used to determine the area touched and the motion pathway(e.g., swipe in the up direction or down direction)

FIG. 3 is a block diagram of an exemplary electrical switch assembly100, illustrating electrical components used to provide the twofunctions of sound transmission and electrical switching in accordancewith one implementation of the disclosure. Wireless devices 140 cantransmit wireless signals 135 to the electrical switch assembly 100.Switch assembly 100 contains an antenna 305 to receive wireless signals135. Antenna 305 can be printed on a circuit board, a discrete stampedmetal component or an electroplated feature on a surface. In oneembodiment of the disclosure the antenna can be deposited or attached toa subassembly including faceplate 105. On advantage of attaching ordepositing the antenna on the faceplate is that placement of the antennaoutside of the metal junction box can improve the antenna range andsensitivity. The antenna is operably coupled to a wireless receiver 306.Receiver 306 can be operable to receive and demodulate a variety ofcommon wireless audio protocols such as amplitude modulated (AM) orfrequency modulated (FM) radio signals (e.g. 88.9-107.7 MHz), Bluetooth,Wi-Fi or Apple Airplay®. Receiver 306 can be part of a transceivermodule that also includes transmission capability. Receiver 306transmits demodulated wireless messages 307 to a speaker processor 308.The speaker process performs operations to convert the digital wirelessmessages into audio frequencies. These operations can includedigital-to-analog conversion, amplification, equalization, errorcorrection, echo cancellation, bass enhancement, or introducing a delayto one or more frequency components. Speaker process 308 and wirelessreceiver 306 can be integrated into a single module or microchip. Forexample a Bluetooth wireless speaker can have a single chip receiver andspeaker processor. Electrical switch assembly 100 can include an audioamplifier 309. Amplifier 309 operates to receive audio signals from thespeaker processor, to increase the power of these signals and totransmit amplified audio signals 316 to the speaker 205. Amplifier 309can be a single chip amplifier or can comprise multiple discretetransistors. Amplifier 309 can be a class A, B, A/B C or D amplifier.Amplifier 309 transmits amplified signals to the speaker. Amplifier 309can be for a PAM1803 Class D audio amplifier available from Diode INC,Plano Tex. The amplifier 309, speaker processor 308, and receiver 306can be housed behind the speaker, away from the path of soundtransmission.

Electrical switch assembly 100 contains a plurality of direct user inputsensors 310. Direct user input sensors operate to sense direct userinteraction with user input regions 240 of the faceplate 105. Examplesof direct user interaction include touching or pressing the faceplate.Examples of direct user input sensors include sensor electrodes 255, 605a, 605 b (shown in FIG. 6) and a load sensors 257 a-d. Other examples ofa direct user input sensor could be a membrane switch such as found onmany modern appliances such as a washing machine or stove control panel.Direct user input sensors 310 can operate to sense direct user inputbased on a variety of standard technologies. Examples of direct userinput technology are capacitive touch sensing, resistive touch sensing,surface acoustic wave touch sensing and pressure sensing. In surfaceacoustic touch sensing a surface acoustic wave is generated on the frontsurface of the faceplate by one or more transmitters. Aspects of thereflected signals (e.g. arrival time and intensity) are used to sense auser touching the faceplate surface. In response to direct user input,sensors 310 generate direct sensor signals 311 a. Direct sensor signals311 a can be current, voltage, frequency or sound intensity changesassociated with user input sensed by one or more direct user inputsensors 310. In some embodiments an electrical connector 315 providestwo separable halves that enable electrical connections to be madebetween conductors 254 and one or more low voltage switches 320. Onehalf of electrical connector 315 may be disposed on a circuit board 260and the other side may be disposed inside the housing 210. When a personattaches circuit board 260 to the housing 210 electrical connector 315can connect electrical signals between conductors 254 and circuitry inthe housing.

In one embodiment of the present disclosure, electrical switch assembly100 provides the two functions of sound transmission and electrical loadcontrol using touch sensitive switches. In this embodiment the grille214 is a touch sensitive surface while the other circuitry required toaccomplish electrical switching function is positioned away from thesound transmission path of one or more centrally located speakers. Theexemplary electrical switch assembly 100 illustrated in FIG. 3 containsa low voltage switches 320. Other implementations may contain multiplelow voltage switches. The switch can be located in housing 210. Theswitch can function to convert sensor signals 311 a and 311 b into lowvoltage switch output signals 322. Low voltage switch 320 can comprise amicrochip or microcontroller. Many modern microcontrollers can havededicated circuitry designed to implement low voltage touch sensitiveswitches. For example the Texas Instruments MSP430 processor from andthe MicroChip DSPic33 processor families have analog-to-digitalcircuitry operable to implement the functionality of the low voltageswitch 320. In some embodiments this circuitry enables conversion ofdirect user interaction with a surface (e.g. touching or pressing) intolow voltage switch output signals 322. In some embodiments sensorsignals 311 can cause small changes in in the frequency of anoscillating circuit inside the low voltage switch 320. The processor isoperable to measure these frequency changes and control one or more lowvoltage switch output signals 322 based on frequency changes. This typeof frequency measurement is often used to transduce sensor signals fromcapacitive touch sensors. Several electrodes can be sequentiallyconnected to a frequency measurement circuit inside low voltage switch320 and switch 320 can identify when the user touches one or more of alarge number (e.g. >50) of distinct regions on the faceplate 105. Inother embodiments the low voltage switch 320 can include ananalog-to-digital converter operable to sense small changes in voltagefrom sensors and generate digital values corresponding to the magnitudeof sensor signals 311. A processor in the low voltage switch 320 canhave a preset threshold for the change in magnitude or frequency thatwould correspond to a user touching the faceplate. When the low voltageswitch 320 measures a change in frequency or magnitude sufficient tocross this threshold the state of an output pin on the low voltageswitch can be changed. The change in state of the output pin can act asa low voltage switch output signal 322. In other embodiments low voltageswitch 320 can include one or more elements designed to increase theoutput power of a low voltage switch signal. This process is sometimescalled “buffering” and can be performed for the purpose of controllinghigh voltage switches 323. Examples of components that can performbuffering include power transistors and relays.

In some embodiments the low voltage switch 320 can accept a large numberof sensor inputs 311 and can produce a large number of low voltageswitch output signals 322, where a large number is for example fifty ormore. In this way the low voltage switch can transduce a plurality ofsensor inputs into distinct switch output signals. In some embodimentsthis circuitry enables conversion of direct human interaction with asurface (e.g. touching or pressing) into output voltage signals. Inother embodiments the low voltage switch can combine several sensorsignals 311 a and 311 b, perform one or more calculations using acomputer processor in the low voltage switch 320 and generate one ormore low voltage switch output signals 322. For example low voltageswitch 320 can receive a direct sensor signal 311 a when a user touchesthe multifunctional grille 214 and second sensor signal 311 b from amotion sensor 269 when a person moves in front of the grille openings.Low voltage switch 320 can contain a processor that can combine directsensor signals 311 a and indirect sensor signals 311 b and generate anoutput signal. In some embodiments the low voltage switch can performtiming calculations to determine when to generate an output signal. Forexample electrical switch assembly 100 can receive direct sensor signals311 a from the region 240 a of the faceplate operable to turn off alight 115 a. About the same time low voltage switch 320 and can receiveindirect sensor input 311 b indicating a person moving in the vicinityof the switch assembly 100. In response to 311 a and 311 b low voltageswitch 320 can delay the transition of signal 322 to an OFF state by afew seconds in order to provide light while the person leaves thevicinity. In the context of this disclosure an ON state can beconsidered as having a voltage with a magnitude that is greater than asizeable portion (e.g. >20%) of a power supply voltage (e.g. 5V) used tooperate a low voltage switch 320. In the context of this disclosure anOFF state can be considered as having a voltage with a magnitude that isless than a sizeable portion (e.g. <20%) of a power supply voltage usedto operate low voltage switch 320. The power supply voltage can bemeasured relative to a reference voltage supplied to the low voltageswitch, often defined as a ground voltage or 0V. Low voltage switch 320can include circuitry to operate one or more illumination components330. Illumination components 330 can be LEDs or electroluminescentsegments, incandescent bulbs or fluorescent bulbs. Illuminationcomponents 330 can be switch position indicator lights operable toindicate to a user the output state of one or more high voltage switches323 or low voltage switch output signals 322.

In other embodiments electrical switch assembly can include one or moreillumination components 330. Illumination components 330 can be operableto illuminate portions 130 of faceplate 105 and can be located on acircuit board located behind the front surface 212 of the faceplate.Connector 315 can also provide a junction for low voltage switch outputsignals 322 d from a low voltage switch 320 to illumination components330. Low voltage switch 320 can operate illumination components 330(e.g. switch position indicator lights) in response to sensor signals.For example in response to a user touching a region of the faceplate,low voltage switch 320 can operate illumination components 330 toilluminate sections of the faceplate 130 a and 130 b indicating thepresent state of each of two dimmer switches. In another example apassive infrared sensor (PIR) could sense a person in the vicinity ofelectrical switch assembly 100 and signal low voltage switch 320 toilluminate regions 130 a and 130 b of the faceplate corresponding to thepresent value of low voltage switch output signals 322 a and 322 b(indicating the dimmer output to switch number 1 and ON-OFF position ofswitch number 2 respectively).

Low voltage switch output signals 322 are operable to control highvoltage switches (e.g. 323 a) and other aspects of the electrical switchassembly 100. Low voltage switch output signals 322 can be voltages inthe range of minus 20 volts to plus 20 volts relative to ground in thejunction box, the neutral wire or a local ground reference voltagesupplied to both the low voltage switch 320 and the high voltage switch323 a. In one implementation low voltage switch output signal 322 a is apulse width modulated signal (PWM) containing a series of pulses. Pulsescontain two or more distinct voltage levels; a high state and a lowstate voltage. By varying the time proportions of high and low statevoltage the PWM voltage waveform voltage switch output signal 322 a cancontrol the dimmer switch 323 a. Other low voltage switch output signals322 b can operate electromechanical relays 323 b. Signals 322 b cansupply a current to an electromagnet inside relay 323 b, therebycreating a low resistance connection between wires 110 b and 110 d. Inthis context a connection with resistance <3 ohms can be considered alow resistance connection. Other low voltage switch output signals 322 ccan be transmitted to the speaker circuitry. FIG. 3 illustrates lowvoltage switch output signals 322 c transmitted to the speaker processor308. For example illumination components 330 can be used to indicate thevolume of speaker 205 as an illuminated section 130 a on faceplate 105.Grille 214 can additionally provide an active region 240 d. In responseto user interaction with 240 d direct input sensors 330 can generatesensor signals 311 a and cause low voltage switch 320 to signal speakerprocessor 308 to change the volume of the speaker. In anotherimplementation low voltage switch output signal 322 b operates a solidstate relay, in which the moving parts of an electromagnetic relay arereplaced with power transistors.

Electrical switch assembly 100 can contain a variety of other componentsand circuits. For example switch assembly 100 can contain a rectifier ordiode rectifier to convert high voltages to low voltages, a battery topower the speaker or low voltage switches, particularly during a poweroutage to the building where the switch assembly is located. Electricalswitch assembly 100 can contain one or more visual displays operable tobe seen through faceplate 105. In some alternative embodiments amplifier309 can be contained within speaker processor 308. In other embodimentsspeaker processor 308 and low voltage switch 320 can be combined in ageneral purpose processor that combines the ability to sense user inputand generate sound signals using digital-to-analog conversion or pulsewidth modulation. An example of a processor that could combine thefunctionality of speaker processor 308 and low voltage switch 320 is theDSPic33 processor family from Microchip Incorporated. In one embodimentof electrical switch assembly 100, the functionality of one or moretouch sensitive regions 240 can be determined by the present state ofone or more low voltage switch output signals 322 a or 322 b. Forexample when a user walks into an room where the lights are OFF, lowvoltage electrical switch 320 can identify that one or more low voltageoutput signals 322 correspond to the light being in the OFF position andcan interpret signals 311 a from some or all touch regions 240 asindications to turn on the light. In this way the electrical switchassembly can identify direct user interaction and estimate theassociated intent based on the output state of one or more electricalswitches (e.g. 323 a). When a person enters a dark room they often reachfor the light switch and use the tactile feel of the switch as userfeedback. In one example electrical switch assembly could devote sensorsignals 311 a from user interaction with some or all of the surface ofthe grille to the function of turning on a light in this scenario,thereby alleviating the user from the burden of touching a particular ONlocation (e.g. 240 c). In this example an indirect input sensor (e.g., alight level detector) located behind the speaker grille could supplysensor signals 311 b to a low voltage switch 320, indicating the lightlevel in the room and enabling the low voltage switch to interpretsensor signals 311 a from a larger number of direct user input sensors310 as indication to operate a high voltage switch to turn on a light.In another example, indirect user input sensors 325 (e.g. a PIR sensoror proximity sensor) could sense a person who has entered a dark roomand illuminate one or more regions 130 of faceplate 105. The indirectinput sensor can benefit from placement behind the grille 214 with alarge density of openings 120 that enhance motion signal intensity. Inone aspect the electrical switch assembly can illuminate features 130with increasing intensity as person gets closer to the faceplate (e.g.as they reach for the switch), thereby avoiding unnecessarily disturbinga person who is moving in the vicinity of the electrical switch assemblyand does not intend to operate an aspect of the assembly. Dynamicintensity variation can be controlled in part by sensing a person with aplurality of different sensing technologies. For example a faceplate canglow with a low intensity when a person is sensed on a long range PIRsensor (e.g. with 10 meter range). The faceplate can glow with a higherintensity if the person is subsequently sensed by a shorter rangeproximity sensor (e.g. active infrared transceiver).

FIG. 4A illustrates several exemplary components of electrical switchassembly 100 designed to enhance audio performance while enablingelectrical switch functionality in according with embodiments of thisdisclosure. Two circuit boards 260 and 460 are positioned behind thefaceplate 105. Circuit board 260 contains a plurality of openings 220and circuit board 460 contains a plurality of openings 420. It can beappreciate that the density and shape of openings in the grille 214 canbe chosen to fulfill the competing goals of sound transmission andmechanical performance (e.g. electrical isolation and speakerprotection). By choosing the size and shape of openings 220 so as not tocover openings 120 with substrate material 262 the sound transmissionproperties of the faceplate 105 can be preserved. In particular byaligning one or more openings 220 and 420 with the grille openings 120the sound transmission performance becomes determined primarily byspeaker grille 214. In the context of this disclosure an opening 220 canbe considered to “align” with an opening 120 when the placement of 220is such that the area of the unobstructed opening formed by theoverlayed combination of 120 and 220 when viewed along an axis is atleast half the area of the corresponding opening 120. For example 220 aand 120 a are considered aligned in FIG. 2A because when assembled thearea of opening 120 a and the area of the opening when 120 a and 220 aare in an assembled state is essentially equal. Opening 220 a is madelarger than 120 a to ensure that any small misalignment of circuit board260 and faceplate 105 following assembly does not cause 220 a to impedesound transmission from speaker 205. In another example openings 120 band 220 b and are considered aligned when the electrical switch isassembled. By aligning one or more openings in the faceplate 105 andcircuit boards (e.g. 260 and 460) the present disclosure enables thecircuit boards to add functionality to the grille while transmittingsound from the speaker. For example circuit boards 260 and 460 canprovide mounting surfaces to hold touch sensor electrodes, indicatorlights, and environmental sensors such as a temperature sensor 480. Inone implementation a connector 315 is used to connect circuit board 460to one or more low voltage switches 320. In the context of thisdisclosure the improved sound transmission as a result of aligningopenings in the grille 214 and a circuit board can include, highervolume experienced in the region in front of the grille, decreasedreverberation caused by reflected sound from grille 214 and the circuitboard and improved audio clarity.

Circuit board 260 can be comprised of transparent conductors and atransparent substrate similar (e.g. clear plastic) to the touchscreenson tablet PCs. Transparent elements on circuit board 260 enable lightillumination components 330 (e.g. light emitting diodes 470 andelectroluminescent regions) on circuit board 460 to illuminate portions(e.g. sections 130) of the faceplate.

Conductive elements 255 can also be a transparent material such asindium tin oxide (ITO), antimony tin oxide or silver filled ink. In oneimplementation an interactive faceplate subassembly 485 is comprised ofthe faceplate 105 and circuit board 260. The interactive faceplatesubassembly 485 can be attached to the other components of theelectrical switch assembly by a user or installer. Interactive faceplatesubassembly 485 enables the alignment of one or more openings 120 andopenings 220 to be conducted in a controlled manufacturing environment.Interactive faceplate subassembly 485 further facilitates installationby enabling installation of other electrical switch assembly components(e.g., the speaker 205 and housing 210) into the junction box 215 priorto installation of the faceplate. This order of installation can help toavoid damaging sensitive sensor electrodes 255 in the interactivefaceplate subassembly 485. In another implementation interactivefaceplate subassembly 490 includes an additional circuit board 460operable to illuminate features on the faceplate. Connector 315 can bedisposed on a pigtail or a portion of flexible PCB designed tofacilitate connection between the two halves of the connector. Connector315 could be comprised of exposed connector electrodes at the end of aflexible PCB pigtail. Connector 315 can connect with a correspondingconnector in the housing 210, for example a zero insertion forceconnector (ZIF) such as those sold by TE Connectivity from HarrisburgPennsylvania. In other implementations interactive faceplate subassembly490 has plurality of connectors similar to 315. Using more than oneconnector 315 provides redundancy in case a connector pin becomes dirtyor damaged. One or more of the connectors can implement a safetyinterlock, thereby ensuring that portions of the electrical switchassembly 100 are not energized with high voltages until faceplatesubassembly is properly secured and the connector 315 is correctlymated. In one embodiment interactive faceplate subassembly 490 has fourconnectors similar to 315, with one located at each corner of thefaceplate to provide a means to both attach and provide power tosubassembly 490. Interactive faceplate subassembly 490 has severaladditional advantages. The subassembly can be provided in a variety ofcolors, shapes and sizes to fit aspects of the wall opening and theuser's preferences. Similarly, the size and pattern of grille member 214can be varied as well as the color of illuminated sections 130. Incontrast the portion of electrical switch assembly 100 inside thejunction box 215 can be standardized and offer less customization. FIG.4B illustrates a crossectional view of the speaker grille subassembly490 including aligned openings. Speaker 205 is shown for reference.

FIG. 5A and FIG. 5B illustrate the basic operating principle ofcapacitive sensing. A number of standard technologies can be adapted toprovide user input sensing in the presence of a large speaker 205 andpluralities of holes 120 220 and 420. These technologies includecapacitive touch sensing (illustrated in FIGS. 5A and 5B), and resistivetouch sensing, surface acoustic wave touch sensing and load sensing. Afinger 505 is placed over a layer of insulating material 510. A targetelectrode 515 is disposed behind layer 510. Electrode 515 has abackground capacitive coupling to a ground electrode similar to 495.When a finger or other object directly interacts with the top surface oflayer 510 the capacitance 525 is often increased. The increase incapacitance causes a temporary current to flow in a conductor such as254 connecting the sensor electrode 255 to a low voltage switch 320.This current constitutes a direct sensor signal 311 a. FIG. 5B alsoillustrates an advantage of the present design. When a finger touches aconventional capacitive touch sensor, over a target electrode 515, asillustrated in FIG. 5A there is an unintended signal generated at aneighboring electrode 530. It is desirable to reduce thiscross-capacitance signal 535 a and 535 b. FIG. 5B illustrates acapacitive touch sensor in accordance with one implementation of thisdisclosure. There is an opening 540 in the insulating layer 510 betweenthe target and neighboring electrodes. This opening can be opening 120in the grille 214. This opening reduces the cross capacitance 535 bbetween the finger 505 and the neighboring electrode 530. By reducingthe undesirable cross-capacitance from 535 a to 535 b the presentdisclosure enables electrodes 515 and 530 to sense more accurately or beplaced closer together. In the present disclosure a plurality of holes120 in the faceplate 105 can cross-capacitance (C2<C1), thereby enablingimproved special resolution of touch identification. Yet anotheradvantage of the present assembly is illustrated in FIG. 5C whereby thetarget capacitance 530 can be increased by extending target electrode515 at least some of the way into opening 540. The extended section isillustrates as the shaded portion 517 of the target electrode in FIG.5C. One way to implement this electrode extension is to increase theplating thickness of electrode 515 close to opening 540. Electrode 515and 530 are examples of direct user input sensors 310.

FIG. 6 illustrates an exemplary electrode array designed to enable atouch sensitive speaker grille in accordance with one implementation ofthis disclosure. A variety of sensor electrodes including 255, 605 a and605 b are patterned on insulating substrate 262. Sensor electrodes areoperable to sense direct user interaction with a variety of regions 240of faceplate 105. The exact layout of sensor electrodes and regions 240will vary from one implementation to another. Electrode 255 is adiscrete sensor electrode designed to identify direct user interactionwith a binary input region of the speaker grille. 605 a and 605 b areelectrodes designed to nest within one another such that a user's fingeris sensed by 2 or more electrodes at most times. Region 610 includes 5nested electrodes and is used to implement a slider touch function. Whena user slides their finger up or down within the dimmer region 240 b ofthe faceplate 105 and grille 214, multiple electrodes in the touchslider electrode region 610 sense the direct user input and send sensorsignals 311 a to the low voltage switch 320. The low voltage switch caninterpolate the sensor signals and estimate the placement of the user'sfinger on the touch sensitive region of the faceplate and grille.Circuit board 260 includes a ground electrode 495 that acts as areference for the other electrodes. Circuit board 260 has a plurality ofopenings 220 places in accordance with aspects of this disclosure so asto enhance sound transmission. The size and location of openings 220 arechosen to align with openings 120. Conductors and electrodes can berouted around openings 220 as illustrated at 625. In some cases oneelectrode can be connected to multiple conductors 254. The conductorscan be routed in different paths around openings 220 to account for thepresence of plurality of openings 220. A person of skill in the artwould appreciate that a dense plurality of openings can be placed onsubstrate 260 and modern circuit board layout software is well suited torouting conductors and electrodes within the small portion of solidsubstrate 262 that can remain. Openings 420 and 220 can have a guardring 630 around the opening, whereby the guard ring is a ring around theopening without electrode material (e.g. copper foil). Guard ring 630can ensure that a user cannot see or touch the edge of an electrode.

FIG. 7 illustrates an exemplary circuit board 460 designed to illuminateregions 130 of the faceplate 105. Light can be generated on circuitboard 460 using a variety of technologies including light emittingdiodes (LEDs) or electroluminescenc (EL). In the embodiment illustratedin FIG. 7 two emitting diodes 470 are electrically connected between twoconductors 254 a and 254 b. Light emitting diodes 470 can beelectrically connected to circuit board 460 while enabling a pluralityof openings 420 to align with openings 120 in grille 214. In this mannerthe LEDs can be used to illuminate sections of the faceplate 105 whilethe circuit board 460 does not diminish the sound transmissionperformance of the electrical switch assembly.

Section 710 of circuit board encloses a region operable to produceillumination by a process of electroluminescence. Electroluminescentmaterials light up when current passes through them. A variety ofelectroluminescent paint kits are available for circuit boardapplications, for example the Luxprint® Electroluminescent products fromDupont. Conductors 254 c are deposited on substrate 460 to define theshape of the electroluminescent region. Conductors 254 c can have closeproximity (e.g. 100 micrometers) thereby enabling intricate conductorshapes to be illuminated. A dielectric layer 725 covers the conductors254 c. The dielectric layer has a high electrical resistance relative tothe underlying conductor 254 c. Dielectric layer 725 can comprise a highdielectric constant material such as barium titanate. The dielectriclayer can alternatively be a solder mask material deposited on thecircuit board 460. An electroluminescent material 730 covers thedielectric layer. Common electroluminescent materials include phosphorand zinc sulfide. One or more top electrodes 740 covers theelectroluminescent layer 730. In this embodiment the top electrode is atransparent electrode such as ITO on a clear plastic film. Alternatingvoltage applied to electrodes 740 and 254 c causes the overlappingregions of the electrodes 740 and 254 c to be illuminated. In someembodiments electrode 740 is large and covers a substantial portion ofthe circuit board 460. The electroluminescent region 710 can beparticularly useful for providing a user with visual feedback regardingthe state of one or more analog 322 a outputs from a low voltage switch320. For example region 710 can illuminate a dimmer switch position onthe faceplate, thereby guiding the user's finger to touch the region ofthe faceplate corresponding to the present dimmer location and raise orlower the light level by dragging their finger to a new location.Conductors 254 c can be closely spaced and can be energized in sequenceas the user moves their finger on the faceplate, thereby tracking theuser's finger with illumination from the original dimmer position to thenew dimmer level. Electroluminescence can produce complex lightpatterns, based on the shape of conductors 254 c. Electroluminescentilluminated regions 710 produce enhanced line edge definition incomparison to LED technology. Conductors 254 c can be patterned so as tocircumvent the openings 420. In this manner the electroluminescentregion 710 can be used to illuminate sections of the faceplate 105 whilethe circuit board 460 and openings 420 enhance the sound transmissionperformance of the speaker 205.

FIGS. 8A and 8B illustrate two additional embodiments of the faceplate105 of electrical switch assembly 100. In FIG. 8A molded features (e.g.805 a and 805 b) on the faceplate can indicate touch sensitive areas.The raised areas can occupy a large portion of the faceplate. The sizeand shape of openings 120 can be designed to enhance sound performanceand switch functionality. In FIG. 8B a plurality of vertical slots 815 aare disposed in a touch sensitive faceplate 105. The openings 815 a canbe designed to produce a characteristic sound and sequence of directuser input sensor signals 311 a electrode when a user moves their fingerin a vertical manner on the dimmer section of the touch sensitivefaceplate 105. In another example, a pattern of horizontal slots 815 bcan be arranged to cover a sensor disposed behind the grille (e.g. apassive infrared sensor 269). In this case the openings can be optimizedto provide more openings with less space between openings in order toenhance sensitivity of PIR 269 to motion.

FIG. 9 illustrates an exemplary rear view of a faceplate with a touchsensitive speaker grille in accordance with one embodiment of thepresent technology. In this embodiment electrodes 255 and conductors 254are deposited directly onto the rear surface of the faceplate 105.Electrodes 255 and conductor 254 can be deposited using a variety oftechnologies including conductive ink or laser direct structuring LDS orselective plating. Electrodes 255 and conductors 254 are deposited on aninterior surface 910 of faceplate 105. Surface 910 contains a pluralityof openings 920 a and 920 b that align with openings 120 a and 120 b inthe front surface of the faceplate, and thereby enhance soundtransmission from a speaker that can be placed behind faceplate 105. Anelectronic component (e.g. an LED, thermistor or resistor) is attachedto the faceplate and electrically connected to conductors 954 a and 954b. This implementation enables one or more electronic components to bedisposed on the rear surface of the faceplate while not impeding soundtransmission from the speaker 205. One or more electronic components 930could be used with electrodes 255 to implement an indicator light thatis locally controlled by signals 311 a generated at touch electrodes 255and do not need to be processed by low voltage 320 in order to generateillumination control signals. Another advantage of the implementationillustrated in FIG. 9 is that alignment of the openings 120 in thefaceplate and openings 920 in touch electrode substrate can be enabledby a single molding operation. In particular, the step of aligning aseparate substrate (e.g., 260 in FIG. 2) is eliminated. Directstructuring technologies such as LDS are well suited to routing narrow(<100 micrometer) conductors 254 around a plurality of closely spacedopenings 920.

OTHER EMBODIMENTS

FIG. 10 illustrates an interactive speaker grille in accordance withseveral aspects of the present disclosure. Interactive speaker grille1005 is designed to transmit sound from a speaker 205, and containsportions that are touch sensitive and operable to illuminate distinctfeatures on the speaker grille. Interactive grille 1005 comprises afaceplate 105 and three circuit boards 260, 1060 and 460 located behindthe faceplate and in front of speaker 205.

Sound transmission is enhanced by aligning a plurality of openings onfaceplate 105 and circuit boards 260,460 and 1060. Faceplate 105 has aplurality of openings 120 that form a speaker grille 214. Whenassembled, opening 120 a aligns with openings 220 a 1020 a and 420 a andthereby promotes sound transmission from speaker 205 to the area infront of faceplate 105. It can be appreciated that a large number of theopenings comprising speaker grille 214 can be aligned with similaropenings on one or more circuit boards to promote sound transmission.The speaker grille 214 contains a plurality of regions 240 in whichdirect user interaction (e.g., touching or pressing) can be sensed by aplurality of electrodes 255 and 605 disposed behind faceplate. FIG. 10illustrate four exemplary regions 240 a, 240 b, 240 c and 240 d whereindirect user input is operable to be sensed by one or more sensorelectrodes 255, 605 a and 605 b on circuit board 260. For example directuse interaction (e.g., touching or pressing) with region 240 c causessensor electrode 255 to generate direct user input signals 311 a. Inanother example region 240 b of the faceplate 105 can function to asanalog switch. The placement position of a user's finger within region240 b indicates a desired user input value to a low voltage switch 320within a range of switch values (e.g. from 0 to 100). Region 240 d is anexample of a multipurpose touch sensitive region of speaker grille 214.Area 240 d can to control a variety of functions in a speakerapplication for example changing the volume, selecting a song, playingor pausing music or selecting an input source. The function of region240 d can be based in part the prior sequence of regions 240 that theuser has interacted with. Illuminated sections of the faceplate, forexample 130 c) can indicate the present functionality of region 240 d.Circuit board 260 contains a plurality of electrodes 255, and 605 boperable to sense direct user interaction with speaker grille 214.Electrodes 254 carry direct sensor signals 311 a to a low voltage switch320. Electrodes 254 are routed around the plurality of openings 220.

Sections of the interactive grille 1005 can be illuminated by lightgenerating components 470 (e.g. LEDs or organic LED) orelectroluminescent sections 710 (illustrated in FIG. 7). Lightgenerating components 470 and electroluminescent sections 710 can beplaced on a circuit board 260 with touch electrodes or can be placed onadditional circuit boards behind the touch sensor electrodes 255 and 605b. FIG. 10 illustrates an LED 470 on circuit board 460 and anelectroluminescent section (shown as 710 on FIG. 0.7). Theelectroluminescent section 710 contains the electrodes 254 c, dielectriclayer 725 and electroluminescent layer 730 described previously in thisdisclosure. In the implementation of FIG. 10 the top electrode 740 isreplaced by a plurality of electrodes 1010 disposed on a third circuitboard 1060. This arrangement enables horizontal electrodes 254 c andvertical electrode 1010 to be operated by signals 322 d (illustrated inFIG. 3) from a low voltage switch 320 and thereby generate anilluminated region 130 c on faceplate 105. Pixel 130 c on faceplate 105is above the region where the two electrodes cross. It can beappreciated that similar pixels of light can be generated at a largenumber of locations where a horizontal and vertical electrode pass overone another. It can be appreciated that the pixels can be disposedaround the plurality of openings 120 and can form a variety of patternsoperable to convey information to a user. In one implementation multipleilluminated pixels such as 130 c can display the function of amultipurpose active region 240 d for example displaying the volume ofthe speaker. In another example an array of pixels 1030 can display anequalizer, indicating the sound volume of particular frequency bands(e.g. 1000-2000 Hz). Such equalizer displays are common on multispeakermusic systems such as the Kenwood GE 100 and provide an aestheticappealing graphical display for the user. A plurality illuminatedregions 130 c can also generate patterns operable to change shape orintensity in time with the beat of a song. It would be understood by aperson of skill in the art that an array of pixels capable ofilluminating individual portions of the speaker grille 214, disposedaround a plurality of openings 420 a and 420 b can also be implementedby a plurality of discrete light emitting light elements 470, such asLEDs, organic LEDs, incandescent lamps or fluorescent lamps.

Electrodes 1010 can be made from a transparent material (e.g. indium tinoxide (ITO), antimony tin oxide (ATO) or silver ink) and thereby enhancelight transmission from electroluminescent layer 730 or discreteillumination devices 705. In FIG. 10 direct sensor signals 311 a aretransmitted to low voltage switch 320. Low voltage switch output signals322 d can be transmitted to electrodes 254 a and 254 b to controlillumination of light emitting elements 470. Light emitting elements 470are examples of illumination components 330 in FIG. 3. Other low voltageswitch output signals 322 d can be transmitted to electrodes 254 c and1010 to control illumination of some or all of electroluminescent region710 (illustrated in FIG. 7). In general a large number of low voltageswitch output signals 322 d can be used to operate a plurality ofilluminated components 330 (e.g. discrete light emitting elements 470 orelectroluminescent region 710) disposed around a plurality of soundtransmitting openings 420 a and 420 b, thereby illuminating sections 130of speaker grille 214. Direct sensor signals 311 a can also be used bylow voltage switch 320 to generate low voltage switch outputs 322 coperable to control aspects of a speaker processor 308. For example auser's finger can touch region 240 b of the interactive speaker grilleand cause sensors in slider region 610 (illustrated in FIG. 6) to sendsignals 311 to low voltage switch 320. The switch can in turn usesignals 311 a to generate low voltage switch output 322 c indicative ofthe position of the user's finger on the volume slider portion of thefaceplate. Speaker processor 308 can use signals 322 c to control themagnitude of signals 316 to the speaker 205. In one aspect of thepresent disclosure, low voltage switch 320 can also produce outputs 322d operable to control illumination of the section of the faceplatebehind 240 d thereby indicating to the user the volume control value. InFIG. 10 circuit board 260 and 1060 can be transparent and containtransparent conductors so as to facilitate illumination of distinctportions of the faceplate by illumination components 705 and 710 oncircuit board 460.

Interactive speaker grille 1005 can enable touch sensitive andilluminated regions of the speaker grille using one or more circuitboards disposed behind the grille have one or more openings that alignwith the openings forming the grille. FIG. 10 illustrates three circuitboards 260, 460 and 1060 in part to illustrate the arrangement ofcomponents (e.g. LEDs and electrodes) on individual substrates. It canbe appreciated the same touch sensing and illumination functionalitiescan be accomplished by combining the individual circuit boards 260, 460and 1060 into a variety of multiple-layer circuit boards. For examplecircuit boards 260 and 1060 can be two separate transparent circuitboards or can be combined into one transparent circuit board with touchelectrodes 605 a and 255 disposed on the surface facing the interactivegrille 214 and illumination electrodes 1010 disposed on the rear surfacefacing circuit board 460. Electroluminescent region 710 can requireintimate contact between electrodes 1010 and the electroluminescent(e.g., phosphor) layer 730. This contact can be accomplished by bondingcircuit board 1060 to board 460 in a manner similar to touch sensitivedisplay fabrication. One or more connectors similar to 315 can connectcircuit boards 260,460 and 1060. A connector can also be used to connectcircuit boards (e.g. 260 or 460) to another circuit board positionedbehind the X-Y plane formed by the flange 206 of the speaker 205.Electrodes on boards 260, 460 and 1060 can also be connected using wiresand solder contacts.

The interactive speaker grille 1005 enables a large area of the speakergrille 214 to be functionalized as a control surface and a displaysurface. In one aspect the speaker grille 214 can be made from anelectrically insulating material, thereby enabling the interactivespeaker grille to identify user interaction with multiple distinctregions of the grille. A dense plurality of openings 120 can facilitateeffect sound transmission. Interactive speaker grille 1005 can devote alarge region (e.g. region 240 d) to speaker controls. As wirelessspeakers have become more compact the surface area devoted to usercontrols has decreased. In contrast interactive speaker grille 1005could devote the whole grille area to controls such as radio stationselection, play, pause or skip to the next song. The touch sensitivecapability and the illumination functionality can be combined toimplement an interactive control. For example many of the speakers onthe market do not have enough available area to provide a volume sliderand therefore require the user to press a volume button multiple timesto increment or decrement volume. This repeated button pushing istedious and the user is often left without a visual indication of thevolume level. Illumination components 330 and low voltage output signals322 c can instead produce a visual pattern of illuminated sections 130 con the interactive speaker grille that effectively indicate the presentvolume level. A user can use a corresponding touch sensitive region(e.g. 240 c or 240 d) to initiate volume change. Touch functionality andilluminated components can be implemented on circuit boards with a denseplurality of openings arranged so as to enable sound impedance of theinteractive speaker grille 1005 in FIG. 10 is determined primarily bythe sound impedance of the grille member 214.

In another embodiment electrical switch assembly 100 can be used toreplace the functionality of a mechanical object (e.g., mechanicaltoggle switch) with which a user associates a characteristic sound(e.g., the “click” sound associated with a light switch or the chimeassociated with a doorbell). A speaker 205 disposed behind the touchsensitive speaker grille can produce the sound familiar to the user.This embodiment has the advantage that the user receives the sound fromthe area that is touches (i.e. the speaker grille) and not from anotherarea away from the touch sensitive surface, which would have thepotential to confuse a user. For example the electrical switch assembly100 could produce a familiar click sound when a user touches an area ofthe grille operable to control an electrical switch. In another examplethe touch sensitive speaker grille could be used to guide a persontowards a touch sensitive surface with audio feedback. For example aperson with visual impairment could follow sound emanating from thetouch sensitive speaker grille in order find the touch sensitive surfaceoperable to control aspects of the speaker or electrical switches. Thesound could vary to indicate that the user if getting closer or furtherfrom the interactive speaker grille.

OPERATION—FIG. 12-15

FIG. 12 is a block diagram illustrating the operation an electricalswitch assembly with audio capability in accordance with one embodimentof the present technology. At block 1210 the speaker 205 receives audiosignals 316 from amplifier 309. At block 1220 speaker 205 emits soundwaves through a pattern of openings in the speaker grille 214 and analigned pattern of openings in one or more circuit boards (e.g.,openings 220 in circuit board 260). At block 1230 a user touches aregion of the speaker grille portion 214 of the faceplate 105, whereinthe region is operable to be sensed by electrodes on circuit board 260or functionalized surface 910 disposed behind the front surface of thefaceplate. At block 1230 electrodes (e.g. 255, 605 a and 605 b) generatedirect sensor signals 311 a. At block 1240 sensor signals 311 a arereceived by one or more low voltage switches 320. At block 1240 the lowvoltage switch processes the signals; determine if the signals meetspecific criteria (e.g. touch location, duration, sequence). At block1250 electrical switch assembly 100 generates one or more low voltageswitch output signals 322 and transmits these signals to one or morehigh voltage switches (e.g. dimmer 323 a connected to wires 110 a and110 c or relay 323 b in FIG. 3). At bock 1260 one or more high voltageswitches (e.g. 323 a) operate to control the connection between one ormore pairs building-based electrical wires. This operating sequenceenables the functionality of a traditional electrical switch to bereplicated using a combination of a low voltage switch and a highvoltage switch, while devoting the space traditionally occupied by themechanical switch to a large speaker centrally disposed in the switchhousing and operable to project sound waves through a touch sensitivespeaker grille.

FIG. 13 is a block diagram illustrating additional steps involved in theoperation of some alternative embodiments of the electrical switchassembly.

At block 1305 electrical switch assembly can receive wireless signals135 from a variety of wireless sources 140. System 100 can use awireless receiver 306, speaker processor 308 and amplifier 309 togenerate audio signals 316. At block 1325 electrical switch assembly 100can illuminate regions of the speaker grille using illuminationcomponents 330 disposed on a circuit board designed with a plurality ofaligned openings, wherein the opening promote sound transmission. Atblock 1327 electrical switch assembly 100 can optionally guide the userto an active region of the speaker grille using one or more illuminatedregions 130. At block 1345 illumination components 330 can be controlledusing low voltage switch output signals 322 d from the low voltageswitch processor 320.

FIG. 14 is a block diagram illustrating the operation an interactivespeaker grille 1005 in accordance with one embodiment of the presenttechnology. At block 1410 the speaker 205 receives audio signals 316from amplifier 309. At block 1420 speaker 205 emits sound waves througha plurality of openings in the speaker grille 214 and an alignedplurality of openings in one or more circuit boards (e.g., openings 220in circuit board 260). At block 1425 interactive speaker grille 1005 canilluminate regions of the speaker grille using illumination components330 disposed on a circuit board designed with a plurality of alignedopenings, wherein the openings promote sound transmission. At block 1430a user touches a region of the speaker grille 214, wherein the region isoperable to be sensed by direct user input sensors 310 (e.g. sensorelectrode 255) on circuit board 260 or functionalized surface 910disposed behind the front surface of the faceplate. At block 1427interactive speaker grille 1005 can optionally guide the user to anactive region of the speaker grille using one or more illuminatedregions 130. At block 1430 electrodes (e.g. 255, 605 a and 605 b)generate direct sensor signals 311 a. At block 1440 sensor signals 311 aare received by one or more low voltage switches 320. At block 1440 thelow voltage switch processes the signals; determine if the signals meetspecific criteria (e.g. touch location, duration, sequence). At block1445 illumination components 330 can be controlled using low voltageswitch output signals 322 d from the low voltage switch processor 320.At block 1450 a low voltage switch 320 generates one or more low voltageswitch output signals 322 c and transmits these signals to a speakerprocessor 308. At bock 1460 speaker processor 308 controls an aspect ofaudio signals 316 sent to speaker 205.

FIG. 15 is a block diagram outlining the operations associated withintegrating audio capability into an electrical switch assembly 100 inaccordance with several aspect of the present disclosure. At block 1510the integration can involve providing a housing 210 including a forwardfacing portion 217. At block 1520 the integration can involve providinga speaker 205 disposed inside the housing. At block 1530 the integrationcan involve providing a faceplate operable to be attached to the housingand to cover the speaker. At block 1540 the integration can involveproviding a grille portion of the faceplate having a first plurality ofopenings for sound generated by the speaker to be transmitted to theregion in front of the assembly. At block 1550 the integration caninvolve providing one or more sensors disposed behind the forward facingsurface of the faceplate and operable to sense direct user interactionwith one or more regions of the forward facing surface of the faceplate.At block 1560 the integration can involve incorporating a secondplurality of openings into the sensor substrate. At block 1570 theintegration can involve aligning at least one of the openings in thefirst and second plurality, so as to promote improved sound transmissionthrough the sensor substrate. At block 1580 the integration can involveproviding a low voltage switch operable to process direct sensor signalsfrom one or more of the sensors. At block 1590 the integration caninvolve providing sensor placement such that one or more of the sensorsare operable to sense direct user interaction with the grille portion ofthe faceplate.

SMART SPEAKERS

Recent advancements in building automation and multimedia (e.g.streaming video and audio) are inspiring media companies to extendwireless speakers to become bi-directional interfaces to smart buildingand the World Wide Web. Voice-activated wireless speakers enable avariety of new uses including controlling local building automationdevices, appliances, issuing web-requests and accessing remote audio andmusic content. Many of these new uses rely on automatic speechrecognition (ASR) and are enabled by arrays of microphones andvoice-recognition algorithms to steer a high gain region or lobe (e.g.beamforming) towards a person speaking in a room. Direct input sensors(e.g. buttons and touch sensitive regions) are common in most wirelessspeakers. A parallel area of development in smart speakers is the use ofindirect input sensors to sense voice commands, gestures, room-layout,person location, person identity and the presence of other smart devicesin the local environment (e.g. in the same room or in the same building)Exemplary indirect input sensors can include microphones, antennaarrays, LIDAR or gesture recognizing RADAR and cameras. Exemplaryindirect input sensors can use a variety of technologies to sense thelocal environment including light detection, thermal detection, passiveinfrared detection, active infrared, ultrasound, sound and capacitivecoupling.

One challenge is that indirect input sensors compete for space withspeaker elements in smart wireless speakers. The size of the speakerelement (e.g. the speaker cone and driver) can impede the performance ofindirect input sensors. For example, in FIG. 16A a speaker 205 and twoindirect input sensors 1610 a and 1610 b (e.g. a motion sensor) arelocated on a common substrate 1620. Speaker 205 comprises a speaker cone1625 and speaker driver 1630 (e.g. an electromagnet). Indirect inputsensor 16010 a has a total field of view 1640 comprising the set of allangles for which sensor 1610 a can transduce indirect input intoindirect input sensor signals (e.g. 311 b in FIG. 3). Speaker 205obstructs a large portion (e.g. portion 1650) of the total field of view1640. Indirect input sensor 1610 b can augment the field of view 1640but nevertheless the presence of speaker 205 considerably complicatessensing aspects of the local environment. In the case of FIG. 16Aplacing the indirect input sensors 1610 a and 1610 b behind the plane ofthe front of the speaker cone (i.e. out of the path of soundtransmission) can improve sound quality but can impede sensorperformance.

FIG. 16B is a disassembled diagram of an alternative solution includingan environmental-sensing faceplate subassembly 1660 a placed in thesound transmission path (e.g. in front) of speaker 205. In theembodiment of FIG. 16B environmental-sensing faceplate subassembly 1660a includes faceplate 1605 with a front surface 1675. A portion 214 ofsurface 1675 contains a first plurality of openings forming a speakergrille. Environmental-sensing faceplate subassembly further comprises anindirect input sensor 325 and a circuit board 260. Circuit board 260 canbe a flat circuit board with an insulating substrate, a flexible printedcircuit board, a molded 2-D or 3-D polymer substrate with attachedconductive elements or plated conductive elements or a ceramic printedcircuit board. Faceplate 1605 can be a portion of the outer housing orenclosure of a speaker assembly. Faceplate 1605 can be similar in designand function to faceplate 105. Circuit board 260 comprises a secondplurality of openings in a second surface 1680. Several opening in thegrille portion 214 of the front surface 1675 can align withcorresponding openings in the circuit board (e.g. 120 b can align with220 b in surface 1680) and thereby promote sound transmission fromspeaker 205. Other openings in grille portion 214 of front surface 1675(e.g. 120 a) can align with one or more openings in circuit board 260(e.g. opening 220 a in surface 1680) and thereby enable indirect inputsensor 325 to sense an aspect of the local environment.

In several embodiments an environmental-sensing faceplate subassemblycomprises: an front surface with a first plurality of openings forming agrille, a circuit board places in the path of sound transmission from aspeaker and an indirect input sensor, wherein the circuit boardcomprises means that enable the indirect input sensor to sense an aspectof the environment in the vicinity of the smart speaker and wherein thecircuit board has a surface with openings that align with the grille topromote improved sound transmission from the speaker.

In another embodiment an environmental-sensing faceplate subassemblycomprises: a front surface, contains a first plurality of openingsforming a speaker grille, an indirect input sensor disposed on a secondsurface behind the front surface with a second plurality of openings,and wherein at least one of the openings in the first and secondplurality of openings are aligned, thereby promoting improved soundtransmission from the speaker. For example the second surface can be therear surface of faceplate 1605 or the housing of a speaker. The rearsurface of faceplate 1605 can be functionalized with conductors andmounting pads for one or more indirect input sensors using the platingtechniques and molding techniques simpler to the faceplate in FIG. 9. Inthis way one embodiment of the environmental-sensing faceplate substratecan be a faceplate portion of a housing with a plurality of openingsextending through a first and second surface on the faceplate such thatopening in the first and second surfaces align in the direction of soundtransmission. An indirect input sensor can be attached to the faceplateand can be encompassed by at least some of the plurality of openings.

FIG. 16C illustrates an alternative environmental-sensing faceplateassembly 1660 b in which indirect input sensor 325 is located on circuitboard 260. Exemplary means by which circuit board 260 can enableindirect input sensor 325 (e.g. a light level sensor) to sense the localenvironment can include: one or more openings (e.g. 220 a in FIG. 16B)to facilitate access to the local environment, a mounting surface forindirect input sensor 325 or one or more electrical connectors (e.g.bond pads 1685) on circuit board 260 to transport electrical signalsassociated with indirect input sensor 325 or conductors (e.g. 254) tocarry power to indirect input sensor 325 or carry sensor signals fromindirect input sensor 325.

In some embodiments of the environmental-sensing faceplate subassemblythe indirect input sensor can sense through the material of thefaceplate. For example the faceplate 1605 can be made from a materialthat is transparent to the sensing technology, such as an opticallytransparent material or an RF transparent polymer. In other embodimentsof the environmental-sensing faceplate subassembly the faceplate portionof the housing can be opaque or non-transmitting to the sensingtechnology. In such embodiments the environmental-sensing faceplatesubassembly enables the indirect input sensor (e.g. 325) to be alignedwith one or more openings (e.g. 120 a) in the exterior surface of thefaceplate (e.g. 120 a aligning with sensor 325 in FIG. 16C).

Turning to FIG. 17, a smart speaker 1700 can include a circuit board(e.g. curved circuit board 1705) in the path of sound transmission froma speaker assembly 1710. The combination of an array of openings andindirect input sensors on circuit board 1705 provides multiple uses forthe space behind the large portion of the speaker housing 1720 oftendevoted to the speaker grille. The external surface 1730 of housing 1720contains a first plurality of openings forming a speaker grille. Theopenings can be grouped to form several portions (e.g. 1715 a and 1715b). Various groups of openings in the plurality of openings canaccomplish a variety of different purposes. For examples, a subset ofthe opening in the grille can accomplish an aesthetic purpose (e.g.defining a shape with the pattern of openings) while another subset ofthe plurality of openings can serve a functional purpose (e.g. enablingenvironmental access for different sensors and speakers). In FIG. 17 aportion 1715 a of the speaker grille has openings designed to align withopenings in circuit board 1705 and thereby promote sound transmissionfrom speakers 205. A second portion 1715 b of the speaker grilleprovides improved access for indirect input sensors 1725 a, 1725 b and1725 c to the local environment (e.g. the region in front of surface1730).

FIG. 18 illustrates a disassembled view of smart speaker 1700 includingtwo grille portions 1805 a and 1805 b of housing 1720. In the assembledposition several first opening (e.g. opening 120 b) in the grilleportions of the housing align with second openings (e.g. 220 b) in thecircuit board 1705 and thereby promote sound transmission illustrates bypath 1810. The first openings can be in the front (or exterior) surface1807 of the grille portion 1805 a of housing 1720 and can align withsecond openings in a surface 1825 of circuit board 1705. Circuit board1705 contains a variety of indirect input sensors (e.g. 1815 encompassedby a plurality of openings, the sensor array comprising 1725 a, 1725 b,1725 c, patterned metallic feature 1840, and 1850). Indirect inputsensor 1815 can be radar, or LIDAR operable to transmit an energy beam1820 into the local environment and characterize the placement ofobjects based on the one or more aspects of reflections from the energybeam 1820 (e.g. time-of-flight, amplitude, phase, dispersion, waveformshape or distortion of the reflections from beam 1820).

GESTURE RECOGITION

One or more indirect input sensors (e.g. 1815) can recognize gesturesmade by a user and thereby control aspects of the smart speaker 1700.For example, indirect input sensor 1815 can be the Soli 76 Ghz radarsystem-on-chip available from Infineon Inc. or Milpitas Calif. and canidentify hand gestures made by a user 125. If the radar were placed in atraditional location away from the path of sound transmission it couldexperience a large radar reflection from the speaker. In the FIG. 18placement of the radar chip on circuit board 1705 in front of speaker205 enables improved access to the local environment. In addition theportion of the housing 1805 a in front of indirect input sensor 1815 canbe modified with openings or an RF transparent polymer to promote radartransmission. Due to the close placement to the housing 1720 only asmall portion of housing 1720 need be modified to enhance the entirefield of view of the indirect input sensor 1815. Indirect input sensor1815 can also be lidar operable to scan a laser beam through the grilleor optically transparent portion of housing 1720. One or more indirectinput sensors (e.g. 1815) can be an LED or laser based lidar thatperforms ranging or gesture recognition based on illuminating some orall of the local environment with visible or infrared light.

Circuit board 1705 can contain one or more conductors 254. Patternedconductors can form one or more antennas (e.g. patch antenna 1840). Theplacement of circuit board 1705 between the sound generating elementsand the grille enables an array of antennas (e.g. 1840) to characterizethe direction of incoming RF signals or the relative strength ofincoming RF signals from different directions. A plurality of antennascan be placed in the path of sound transmission and utilize more spacethereby improving the antenna gain. Indirect input sensor 1850 can be anactive ultrasound sensor and can utilize a portion of the grille e.g.opening 120 a to transmit a signal 1860 into the local environment andsense or characterize the location of people (e.g. 1870) or objects.Indirect input sensors 1725 a, 1725 b, and 1725 c can be a beamformingmicrophone array and utilize a portion of the speaker grille (e.g.portion 1715 b in FIG. 17 to identify the direction of speech. In oneembodiment indirect input sensors can be mounted on an interior surfaceof housing 1720 in FIG. 17. Housing 1720 can comprise the plurality ofaligned openings on a first and second surface. In yet anotherembodiment one or more of the opening in the circuit board 1705 can formpart of an indirect input sensor (e.g. part of an antenna) or can formpart of a conductive path (e.g. a via hole for a conductor). For exampleone of the openings in the plurality of openings on the circuit boardcan be designed to both align with an opening in the grille and can be aplated hole thereby forming part of conductive pathway for current onthe circuit board.

FIG. 19A illustrates an embodiment wherein a circuit board 260 with anindirect input sensor 325 is in the path of sound transmission 1940 abetween a speaker 205 to the front surface 1730 of housing 1720. In theembodiment of FIG. 19A speaker 205 generates sound by vibrating indirections 1950 while circuit board 260 is perpendicular to thedirections of vibration of the speaker and perpendicular to thedirection of sound transmission 1940 a. Several openings in housing 1720align with openings in circuit board 260 (e.g. openings 1910 and 1920)such that the combined sound impedance of the aligned openings whenviewed along the direction of sound transmission is substantially equalto the sound impedance of the grille openings alone. In the embodimentof FIG. 19A speaker 205 generates sound by vibrating in direction 1950while circuit board 260 is perpendicular to the direction of vibrationof the speaker and perpendicular to the direction of sound transmission1940 a.

FIG. 19B and FIG. 19C illustrate another embodiment, that is common withbass speakers wherein the path of sound transmission undergoes adirection change between generation in direction 1950 and passingthrough the grille. Nevertheless, circuit board 260 with an indirectinput sensor 325 is in the path of sound transmission 1940 b fromspeaker 205 to the front surface 1730 of housing 1720.

FIG. 20 illustrates a related embodiment in which a circuit board 2010with plurality of openings is positions in the sound transmission path(e.g. in front of the cone) of a speaker 205. The plurality of openingsin the circuit substrate can encompass a display 2020 (e.g. an LCD or anorganic LED display). The circuit board is positioned behind a faceplate2030 that contains a first plurality of openings. Some of the firstplurality of openings (e.g. opening 120 b) align with openings in thecircuit board (e.g. opening 220 b), thereby promoting sound transmissionfrom the speaker 205. In a traditional display with speakers (e.g. aflat screen TV) the speakers can be mounted at the side of the display.The width of side-positioned speakers determines at least in partability or effectiveness of the speaker to create low frequency soundwaves (e.g. the ability to create deep bass sounds). In this way narrowspeakers positioned on either side of the display often have a smallerfrequency range than a larger speaker positioned behind the display (asillustrated in FIG. 20). Hence one advantage of arrangement 2000 is toenable lower base tones using a larger speaker positioned behind thedisplay. Circuit board 2010 and in particular the aligned openings (e.g.120 b and 220 b) in the circuit board and the faceplate enabletransmission of the speaker sound while displaying images. One area ofapplication for the embodiment of FIG. 20 is locations where the areafor a display is limited while sufficient depth is available to mountthe speaker behind the display. Exemplary applications includeappliances (e.g. smart thermostats), smart routers and smart lightswitches where a large (e.g. 4×4 inch) speaker can be mounted behind adisplay in a 2-bay electrical junction box.

FIG. 21 illustrates a method 2100 for integrating environmental sensinginto a smart speaker. At step 2110 a speaker is provided. The speakercan be part of a speaker assembly such as speaker assembly 1710 in FIG.17. At step 2120 a housing is provided. The housing can comprise severalattached parts (e.g. two halves of a clamshell molded housing or ahousing similar to 210 with a faceplate similar to 105 in FIG. 2). Thehousing is provided with a grille portion comprising a first pluralityof openings. The grille portion can be a molded array of holes in aportion of the housing or a metal mesh component of the housing.

At step 2130 a circuit board is provided with a second plurality ofopenings. The circuit board can have at least one electronic componentdisposed on the circuit board. Exemplary electronic components that canbe disposed on the circuit board include, an indirect input sensor, awire, a conductive metallic trace, a resistor, a diode, a capacitor, ainductor, a microchip, a button or an LED. The at least one electroniccomponent can be disposed on the circuit board by mechanically attachingit to the board (e.g. gluing, fastening or insert molding) orelectronically connecting it to the circuit board (e.g. soldering,crimping or mating to a connector on the circuit board).

At step 2140 the circuit board is positioned in the housing such that atleast one of the openings in the second plurality of openings alignswith one or more of the openings in the first plurality of openings,thereby promoting improved sound transmission from the speaker. Thepositioning at step 2140 can involve placing the circuit board withinthe housing, in the path of sound transmission.

At step 2150 one or more indirect input sensors are provided. At step2160 means are provided on the circuit board to enable sensing of one ormore aspects of the environment in the vicinity of a smart speaker by atleast one or the one or more indirect input sensor. Exemplary meansinclude electrical bond pads to attach the indirect input sensor on thecircuit board or mechanical attachment (e.g. fastening) features on thecircuit board to mechanically connect the direct input sensor to thecircuit board. Other means on the circuit board to enabling sensing bythe indirect input sensor include one or more opening in the circuitboard to enable the indirect input sensor to sense the region beyond thegrille, wires or conductors disposed on the circuit board to providepower to the indirect input sensor or carry indirect input sensorsignals from the indirect input sensor. Other means on the circuit boardinclude conductors or components that act to gather or condition aninput signal from the environment (e.g. antenna elements for a radarchip or a filter network, such as a frequency selective band-pass filterdisposed on the circuit board).

The invention claimed is:
 1. A smart speaker comprising: a first speakercomprising a speaker cone, and an environmental sensing faceplatesubassembly comprising: a front surface, wherein at least a portion ofthe front surface comprises a first plurality of openings forming aspeaker grille; wherein each of the first plurality of openingsfunctions to transmit sound from the first speaker through the frontsurface to an environment in a vicinity of the smart speaker; anindirect input sensor, to sense electromagnetic energy from theenvironment in the vicinity of the smart speaker through at least one ofthe first plurality of openings, the indirect input sensor beingdisposed behind the front surface on a second surface having a secondplurality of openings; and wherein at least one of the second pluralityof openings is aligned with one or more of the first plurality ofopenings, thereby facilitating sound transmission from the speaker conethrough the environmental sensing faceplate subassembly.
 2. The smartspeaker of claim 1 further comprising an electrical conductor connectedto the indirect input sensor, disposed on the second surface, andwherein at least a portion of the conductor is encompassed by the secondplurality of openings.
 3. The smart speaker of claim 1 wherein theindirect input sensor is encompassed by at least some of the secondplurality of openings.
 4. The smart speaker of claim 1 furthercomprising a circuit board located behind the front surface of theenvironment sensing faceplate subassembly, wherein the indirect inputsensor is located on the circuit board, and wherein the circuit boardcontains the second plurality of openings.
 5. The smart speaker of claim4 wherein the circuit board is in a path of sound transmission betweenthe speaker cone and the speaker grille.
 6. The smart speaker of claim 5wherein the circuit board covers at least a portion of the speaker cone,and wherein the circuit board is perpendicular to a direction ofvibration of the first speaker.
 7. The smart speaker of claim 1 whereinat least one of the openings in the first plurality of openings enablesthe indirect input sensor to sense the one or more aspects of theenvironment in the vicinity of the smart speaker.
 8. The smart speakerof claim 1 wherein the speaker grille is further defined as a region ofthe interactive faceplate subassembly encompassing at least some of thefirst plurality of openings and wherein the region is bounded by apolygon, the polygon comprising a plurality of straight line segments,wherein each straight line segment in the plurality of straight linesegments touches the perimeter of at least two of the openings in thefirst plurality of openings.
 9. The smart speaker of claim 1 furthercomprising a processor operably coupled to the indirect input sensor andthe first speaker to receive indirect sensor signals from the indirectinput sensor and cause the first speaker to generate one or more soundsbased at least in part on the indirect sensor signals.
 10. The smartspeaker of claim 1 wherein the indirect input sensor is based on atechnology from a group of technologies consisting of radio frequencysignal detection, radar detection, light detection, thermal energydetection and passive infrared detection.
 11. A device for generatingsound, comprising: a. a speaker comprising a speaker cone; b. a housingcomprising: a front surface; and a speaker grille comprising a firstplurality of openings, wherein each of the first plurality of openingsfunctions to transmit sound from the speaker through the front surfaceto an environment in a vicinity of the smart speaker; wherein thespeaker grille functions to provide sound transmission from the speaker;and c. and one or more indirect input sensors to sense electromagneticenergy from the environment in the vicinity of the device through atleast some of the first plurality of openings; wherein the one or moreindirect sensors are disposed on a second surface, wherein the secondsurface comprises a second plurality of openings and wherein at leastone of the openings in the second plurality of openings aligns with anopening in the first plurality of openings, to enhance soundtransmission from the speaker cone, through the second surface, to theenvironment in the vicinity of the device.
 12. The device of claim 11further comprising: one or more regions of the housing through which theone or more indirect sensors sense the one or more aspects of theenvironment in the vicinity of the device, and wherein at least one ofthe one or more regions of the front housing includes at least a portionof the speaker grille.
 13. The device of claim 11 further comprising: acircuit board disposed behind the front surface of the housing, whereinat least a portion of the circuit board is in a path of soundtransmission from the speaker to the speaker grille, and wherein thecircuit board comprises the second surface.
 14. The device of claim 11wherein at least one of the one or more indirect input sensors isencompassed by at least some of the openings in the second plurality ofopenings.
 15. The device of claim 11 further comprising a short rangewireless receiver, and a processor operable coupled to receive indirectsensor signals from the one or more indirect input sensors and generateoutput signals which control an aspect of the device, based at least inpart on the indirect sensor signals.
 16. The smart speaker of claim 11wherein in an assembled state the number of openings from the firstplurality of openings that align with openings from the second pluralityof openings, is at least
 50. 17. A method of integrating environmentalsensing into a smart speaker comprising: providing a speaker; providinga housing, with a grille portion comprising a first plurality ofopenings; wherein the first plurality of openings functions to transmitsound from the speaker through the grille portion to an environment in avicinity of the smart speaker; providing a circuit board comprises asecond plurality of openings; providing an indirect input sensor coupledto the circuit board, operable to sense electromagnetic energy from theenvironment in the vicinity of the smart speaker through at least someof the first plurality of openings; and positioning the circuit boardwithin the housing such that at least one of the first plurality ofopenings aligns with at least one of the second plurality of openings,thereby facilitating sound transmission from the speaker through thecircuit board.
 18. The method of claim 17 further comprising the step ofpositioning the indirect input sensor relative to the circuit board suchthat the indirect input sensor is operable to sense the one or moreaspects of the environment in the vicinity of the smart speaker troughone or more of the second plurality of openings.
 19. The method of claim17 further comprising the step of positioning the indirect input sensorrelative to the circuit board such that the indirect input sensor isoperable to sense the one or more aspects of the environment in thevicinity of the smart speaker trough the at least one of the secondplurality of openings that aligns with the at least one of the firstplurality of openings.
 20. The method of claim 17 further comprising thestep of electrically coupling the indirect input sensor to the circuitboard such that the indirect input sensor is positioned to sense the oneor more aspects of the environment in the vicinity of the smart speakerthrough the grille portion of the housing.
 21. The method of claim 17further comprising the step of attaching the indirect input sensor tothe circuit board such that the indirect input sensor is encompassed byat least some of the second plurality of openings.
 22. The method ofclaim 17 further comprising the step of positioning the circuit board ina path of sound transmission between the speaker and the housing suchthat at least some of the second plurality of openings facilitate soundtransmission into the vicinity of the smart speaker and such that atleast some of the first plurality of openings facilitate the indirectinput sensor to sense the one or more aspects of the environment in thevicinity of the smart speaker.